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Matrix factorization identity for almost semi-continuous 
processes on a markov chain 



D.V. Gusak, E.V. Karnaukh UDC 519.21 

In this article almost semi-continuous processes with stationary independent increments on a finite 
irreducible Markov chain are considered. For these processes the components of matrix factorization 
identity are concretely defined. On the basis of this concrete definition the relations for the dis- 
tributions of extrema and distributions of their complements for the almost upper semi-continuous 
processes are established. 



The processes with stationary independent increments on a Markov chain are considered in [1] - [4] . 
These processes also were considered in [7], where they were called as in [1,2] the risk processes in a 
Markovian environment or Markov additive processes. 

We'll consider the two-dimensional Markov process: 

z{t) = {m,<t)} (i>o,e(o) = o), 

where x{t) is a finite ergodic Markov chain with state space E' = {1...to} and transition matrix 
P(i) = e**^, t > 0, Q = N(P — I), where N = Hf^fer '^fe||™r=i' are parameters of the exponentially 
distributed random variables Cfc (the sojourn time of x{t) in state k), P = \\pkr\\ is the transition matrix 
of the embedded Markov chain. 

Let (7,1 = Sfc<nCfej Vn = x{an). We suppose that under conditions x{an — 0) = fc, x{t) = r, t E 
[an, cr„+i) £,{t) is determined by the processes with stationary independent increments £,r{t) (Cr(0) = 0) 
and by the independent jumps Xkr {k ^ r) at the moments (t„. ^r{t) have the cumulant functions: 

1 r°° 

il)r{a) = laar - -b^a^ + / [e*"^ - 1 - iax6{\x\ < l)]Ur{dx), 



2 

\ar\ < (X),bl < oo, Tlr{-) are spectral measures of ^^(0- A'^d we denote F{x) = \\P{xkr < x;yi = r/yQ = 
fc}||- 

The evolution of the process Z{t) is determined by the matrix characteristic function(ch.f.): 
*t(a) = ||E[e'"(«(*+")-^("»,x(t + u) = r/x{u) = fc]|| u > 0, 
this ch.f. we can represent in the next form 

*t(a) =Ee*"«(*) =e**("\ *(0) = Q, 

/ e*"^dF(a;) - I ,*(0) = Q. 

J —OQ 



*(a) = ||V'fc(a)4.||+N 



Let 9s denote an exponentially distributed random variable with the parameter s > (P{^s > i\ = 
e""**,* > 0). We assume that 9s is independent on Z{t), then 

/•oo 

*(.s,a) =:Ee*"«(''=) =s / e"'**t(a)di = s (si - (1) 



This is an electronic reprint of the original article published in Theory of Stochastic Processes, Vol. 11 (27), no. 1-2, 
2005. This reprint differs from the original in pagination and typographic detail. 

Institute of Mathematics Ukrainian National Academy of Science, 3 Tereshenkivska str., 252601 Kiev, Ukraine. 
random@imath.kiev. ua 

Department of Probability and Mathematical Statistics, Kyiv National University, 64 Vladimirskaya str., 252017 Kyiv, 
Ukraine. kveugene@mail.ru 

AMS 2000 subject classifications. Primary 60G50, 60J70. Secondary 60K10, 60K15. 

Key words and phrases: Matrix factorization identity, almost semi-continuous processes, Markov environment. Ruin 
probability. 



P, = s / e-"*P(i)di = s (si - Q)"^ . 
Jo 

Let us denote the next fimctionals for ^{t): 

= sup ^(w), m = m~eit), r(t)= inf m^m-nt), 

0<u<t 0<u<t 

T+{x) = M{t : at) > x}, ^+{x) - - X, 

7+(x) = X - <e(T+(a;) - 0), 7+ = 7+(a;) + 7+(a;), x> 0, 
T"(x) = inf{t : ^(t) < x}, x < 0. 

and the distributions 

P+(s, x) - P {^+(0.) >x},x>0,p+{s)^P {^iOs) = 0} , q+(s) - P, - p+(s); 

P+(s,x) = P > x} , X > 0,p+(s) = P - 0} , q+Gs) = P, - p+(s); 

p-(s,x) =P{^(0,) <x},P_(s,x) =P{r(^s) <x}, x<0. 

Lemma 1. [3] for </ie two-dimensional Markov process Z{t) = {^t), x{t)} the basic factorization 
identity is valid 



^ ' \*_(s,a)Pri*+(s,a), 



where 



(2) 



*_(s,a) = Ee'"?"^''^). 

In papers [3, 4] the concrete definition of components of (2) for the semi-continuous processes was 
obtained. We want to derive analogical concrete definition for the almost semi-continuous processes, 
that were investigated for the scalar case (m = 1) in paper [5]. Before this let us consider some auxiliary 
definitions and statements. 

Let Jim{a) is the Banach algebra of matrices with dimension m x m, the elements of these matrices 
are the Fouricr-Stieltjcs transforms of the functions fkr{x), k,r = l..m, with bounded variation. 

If $ — G Bm(a), $(a) = || e^^^dfkrix)]], then we determine projection operations by the 

next relations 



[$(«)]± = II ± / ' 

^±0 

nzLOO 

ma)]l = \\ct± d/,.(x)||. 



e'^^'dhrix) 

f ±00 



The relation between the distribution of C^{Os) and generating function of T'^iz) is vahd: 



P+(s,z) =E 



-sr+(z) ^+ 



T {z) < 00 



(3) 



In the sequel we will denote E 



, T (z) < 00 = T (s, x), taking into account that the generating 



function of t^{z) is considered on the chain x{t^[z)). Note that the state space of the chain x (r^(z)) 
can be narrow due to nonattainability the level z > (z < 0) by the process ^(t) . Therefore we impose 
the next conditions 



{k : P{.T (t±(z)) fc} > 0} = E', {k : V{x (t±(z)) = fc} = 0} = 0. 
||E[|e(t)|,x(t)=r/.T(0) = fc]||<oo. 



(4) 
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We'll use the next notation 

dKo{z) = NdF(z) + U{dz), Ko{x) = / dKo(z), 

vf+{a, u, V, /i) = 



Jo Jo Jx 



V {s,a,u,v, fi) = / e''°'^'V+{s,x,u,v, fj,)dx 
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g-sr+(2:)-ti7+(3:)-t)7+(a;)-/i7+^ ^+^^^ ^ ^ 



p . )^ , - (^^P-(s,x)U=oB2 + A+) , B > O; 

s-i [*-(s,a)]^A+, B = 0. 

A+ = ||Jfc.<5(&fc = 0,afc > 0)afc||, A+ = 114.-5(0^ > 0)afe||,B = \\5krbl\\. 
Lemma 2. [3] // condition (3) is satisfied, then 

v+{s,a,u,v,^J.) = *+(s,a)P7^ (c,(s) + s"^ (s, a)w+(a, m, ^)] ° ) 



If we denote 



dP-{s,y)Ko{x~y), k(s,a)=/ e'"^K(s, a;)da;, 
) Jo 



then from lemma 2 the next statement follows. 
Theorem l.If condition (4) is satisfied, then 



*+(s,a) = (I-ia(a(s) + s-ik(s,a))) ' P, 



dx. 



(5) 



(6) 



Proof. Let's substitute u = w = /i = in formula (5), then 

v+(s,a,0,0,0) = *+(s,a)P;i (a(s) + s-i [*- (s, a)w+(a, 0, 0, 0)] ° ) , 

where 



[*"(s,a)w+(a, 0,0,0)]^ 



-, 



e'"^^dP-(s,a;) / e"'''Ko{x)dx 



oo ^0 



dP (s, i/)Ko(a; — ?/)da; = k(s, a). 



Using formula (3) and definition of v+, we have 



v+(s,a,0,0,0) = / e*"^E 
/o 



(7) 



T+(a;) < oo dx= / e'^^PIC+Ce*.) > x}dxP;i 



= -(*+(s,a)-P.)P, 



Let's substitute received relations in formula (7) 
1 



(*+(s,a) -P,)P;i = *+(s,«)P,-i (a(s) + s-ik(s,«)) , 
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whence we receive (6). In paper [3] the representation of €>+(s,Q!) in terms of the joint generating 
function of {t+(0), 7+(0)} was obtained. Formula (6) is the another way of representation of $+(s,Q!) 
in terms of the integral transform of the convolution F~{s,x) with Ko(a;). In some partial cases the 
distribution of P~(s, a;) has the exponential form. Then the integral transform of the convolution k(s, a) 
has more simple form. □ 

Let us consider the analogy of the almost upper semi-continuous scalar process analyzed in paper [5] . 
The process Z{t) = {^{t),x{t)} is the almost upper semi-continuous process on a Markov chain, if 
B = O, A < 0, and J^^uldx) = A < oo, U{dx) = AdFoix), where Fo(a;) = \\SkrF^{x)\\, F^{x) 
are the distribution functions of jumps of £,{t), when x{t) = k. A = \\Skr^k\\, Afc are parameters of 
the exponentially distributed random variables (the time between two consecutive jumps of £,{t) if 
x{t) = k). We also assume that dKo(z) = Aro(0)Ce~'^^dz, z > 0, where C = ||(5fcrCfe||(cfc > 0) (the 
positive jumps of ^(i) have exponential distributions with the parameters if x{t) = k). Under these 
conditions the cumulant of Z{t) has the next form 

— r° 

*(a) = laA + AFo(0)C (C - laiy^ + / e'"^dKo(a;) - A - N. 

— oo 

For the almost upper semi-continuous process Z{t) we have the next concrete definition of components 
of the first part of (2). 

Theorem 2. For the almost upper semi- continuous processes the distribution o/^^(0,,) is determined 
by the next relations 

*+(s,a) = (C - tal) {p+{s)p-'C - p+(s), (8) 

p+is) = s (si + E e«(^=)CAFo(0)) P,; (9) 



P+(.s,a;) =q+(.s)e-^»"'*^P+(")^ a; > 0, (10) 
/or C(0,) = m)-^+i9s) we have 

*-(s, a) = PsP+\s) [*(s, a)]_ - q+(s)p;i(s)C [(C - taiy' *(,s, a)] _ , (11) 

nOO 

p-(s,x) =P,p;i(s)P(s,x) -q+(s)p;i(s)C / e~''ypis,x-y)dy, x < 0. (12) 

Jo 

Proof. Substituting dKo(z) = AFo(0)Ce~*^''dz, z > in formula (6), we obtain 

^+{s,a) ^ (l-ia(^C,{s) + s-^ J dP" (s, ?/)e*^^'AFo(0) (C - lal)"' j ^ P,. (13) 
Under conditions of the theorem: C, (s) = O, then 

^+{s,a) = (l~ias-^ J dP-(s,y)e*^yAFo(0)(C-iaI)"^^ P^. 



(14) 



Hence 



p+(s)= hm *+(s,a) = fl + s-i r dP~is,y)e^yAFoiO)) P. 



(15) 



Substituting (15) in (14) and taking into account that dP {s,y)e^y = Ee^'^^^'-' we obtain (8). To 
prove formula (10) let us invert (5) with respect to a: 



j-X rO 

sV+{s,x,u,v,fi) = dP+{s,z)P~^ dP~{s,y)W{x - y - z,u,v,fi). 

Jo J-oo 



(16) 
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Letting w = u = /i = we have 

sV+(s,x,0,0,0)= / dP+{s,z)P-^ f dP-{s,y)Ko{x-y-z). 

Jo J -oo 

Taking into account (3) and the condition of the almost semi-continuity we obtain the equation 

sT+{s,x)^- f dT+{s,z) f dP-(s,y)AFo(0)e*^(«+")e~*^^. (17) 

Jo J -oo 

Let's differentiate with respect to a; > then we have the next equation for T+(s,x): 

^T+{s,x) = -T+{s,x)Cp+{s)p-\ x>0, (18) 

T{s,0) = (i+{s)P-\ 
The solution of equation (18) is expressed by the next formula 

T+(s, x) = T(s, 0)e~^P+(")P="'". (19) 
Taking into account formulas (19) and (3), we have 

P+{s,x)^T+{s,x)P, 

= q+(s)P;ie-'='P+(^)P="'^P, 

= q+(s)e-P"'f^P+(^)^ 

The representations of ^^{s,a) in (11) we can obtain from the first part of factorization identity (2), 
substituting instead of ^+{s,a) its representation from formula (8). Formula (12) is received by the 
inversion of (11) with respect to a and by the integration with respect to z. □ 

Further we consider the concrete definition of components of the second part of (2). 
Theorem 3. For the almost upper semi- continuous processes the distribution of ^{9s) = £,{9s) — 
^~{0s) is determined by the next relations: 

*+(s, a) = p+(s) (CP;ip+(s) - laiy' (C - tal) , (20) 

p+{s) = ,sP, (si + AFo(0)E eC«"(''^^)) , (21) 

P^{s,x) = e-P+(^'^^="'"q+(s), x>0- (22) 
for the minimum ^^{6^) we have: 

*_(s, a) = [*(,s, a)]_ P+\s)Ps - [*(., a) (C - taiy'] Cp;i(s)q+(s), (23) 



P.{s,x)=P{s,x)py{s)Ps~ P{s,x~y)e-^ydyCpy{s)ci+{s), x<0. 

Jo 



(24) 



Proof. Note that we'll consider such trajectories of the process for which {t~{x) < oo}. Then the 
stochastic relations for t^^{x) (fc, r = 1, to) if x < 0, where lower indices denote the initial state and the 
state of x(t) at the moment of achievement the level x, correspondingly {x(0) = k, x {t~ (x)) = r), have 
the next form 



5 




6 



After the limit passage m ^ oo in (32) formula (21) follows. Substituting (21) in (32) wc obtain (20). 
After inversion of (20) with respect to a formula (22) follows. Substituting (20) in the second row 
of (2) we obtain (23). Formula (24) is received by the inversion of (23) with respect to a and by the 
integration with respect to 2. □ 

Remark 1. Let Z{t) = {(,{t), x{t)} be the almost upper semi-continuous process, then the process 
Zi{t) = {—^{t), x{t)} is the almost lower semi-continuous process. Taking into account the next relations 
between the ch.f. of extrema for Z{t) and Zi{t): 

^f^^{s,a) = *±(s,-a), *£'(s,a) = *=^(s,-a), 

we can obtain the statements about the concrete definition of components of (2) for the almost lower 
semi-continuous processes. 

Remark 2. In theorems 2 and 3 we have considered the case A < 0. Analogical results take place if 
we assume that A = 0. In this case we should take into account that P-(s) = P (^s) = 0} 7^ and 
p_(s) = P{?(0.)= 0)7^0. 

We'll need some further notation. Let (tti, . . . , 7r,„) be the stationary distribution of x{t), 



mm / r \ r 

ml = ^TTfc^mfcr, rukr = Skr [ak + j xllk{dx)j + j 

K(r) = *(-ir). 

By results of [6] it follows that 

lim P(i) = lim P^ = lim s (si - Q)"^ = Pq, 



XUkdFkrix), 



„0 II „0 



P0=|bLll, pt = 7Tr>0, 



if |mj| > then 

limrK-i(r) = limr(Q-f rMi)"^ = ^Po, Mi = A + / xdKo(x). 
Theorem 4. // > then for the almost upper semi- continuous process Z{t) the distribution of 



strictly negative values of ^ 



inf S,{u) is determined by the generating function 

< u < 00 



E 



''K-i(r)(C-rI) 



R4 



if A — Q then 



P- = P {r = 0} = (A - N (f (0) - I)) R+, 



(33) 
(34) 



where R+ = lim sR, ^(s) = lim sp , ^(s)Ps, f(0) ||P{Xfer = 0,?/i = r/y^ = fc} ||. 
Proof. From formula (20) and factorization identity (2) it follows that 

*_(s, a) = *(s, a) (C - laiy^ (CP;ip+(s) - lal) p;^(s)P, 



or 



^e'^-io^) ^s{sl- K(r))"' (C - riy^ (C ~ rR;i(s)) . 
From relation (35) it follows that 

lim lim Ee'^«"(^=) = ^PoC^iR+. 



r-»0 s-»0 



TOY 



(35) 
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Hence the condition rrii > provides the existence of hmsR^^(s) = R+. Then from (35) after 

the Umit passage (s — > 0) formula (33) follows. If A = let us consider the probability P^j.{t) = 
P {^{t) = 0, x{t) — r/x{0) = k} which satisfies the next equation 

P°,(t) = + / „ke-^''>'+^''^y V P {xfe, - 0, j/i = j/yo = k} P^,{t - y)dy. (36) 

Applying Laplace-Karson transform to equation (36) we obtain the next equation 

P°(s) = (si + N + A)"^ (si + Nf (0)) P°(s) 

or ^ 

P°(s) = s (si + A - N (f (0) - I))-' . (37) 

Applying to the first part of (2) operation []" and taking into account formula (37) we obtain relation 
p_(s)P7ip+(s) = P-(s)R+(s) = s (si + A - N (f(0) - I))-^ 

or 

p_(s) = (si + A - N (f(0) - I))"' sR;1(s). (38) 
After the limit passage (s 0) from (38) formula (34) follows. □ 
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